Designing and Evaluating Virtual Musical Instruments: Facilitating Conversational User Interaction
نویسندگان
چکیده
This paper is concerned with the design of interactive virtual musical instruments. An interaction design strategy which uses on-screen objects that respond to user actions in physically realistic ways is described. This approach allows musicians to ‘play’ the virtual instruments using the sound of their familiar acoustic instruments. An investigation of user experience identified three modes of interaction that characterise the musicians’ approach to the virtual instruments: instrumental, ornamental and conversational. When using the virtual instruments in instrumental mode, musicians prioritise detailed control; in ornamental mode, they surrender detailed control to the software and allow it to transform their sound; in conversational mode, the musicians allow the virtual instrument to ‘talk back’, helping to shape the musical direction of performance much as a human playing partner might. Finding a balance between controllability and complexity emerged as a key issue in facilitating ‘conversational’ interaction.
منابع مشابه
Designing for Conversational Interaction
In this paper we describe an interaction framework which classifies musicians’ interactions with virtual musical instruments into three modes: instrumental, ornamental and conversational. We argue that conversational interactions are the most difficult to design for, but also the most interesting. To illustrate our approach to designing for conversational interactions we describe the performanc...
متن کاملTowards Participatory Design and Evaluation of Theremin-based Musical Interfaces
Being one of the earliest electronic instruments the basic principles of the Theremin have often been used to design new musical interfaces. We present the structured design and evaluation of a set of 3D interfaces for a virtual Theremin, the VRemin. The variants differ in the size of the interaction space, the interface complexity, and the applied IO devices. We conducted a formal evaluation b...
متن کاملMimesis, a Visual and Musical Instrument
In this demonstration we present Mimesis, a virtual environment with interactive stereoscopic real time graphics and interactive sound that works as a visual and musical instrument. We have developed two display systems, a spatialized sound system and a passive horizontal stereoscopic visual system, that help users create visuals and music. Both systems work together increasing the sense of imm...
متن کاملInteracting with the 3D Reactive Widgets for Musical Performance
While virtual reality and 3D interaction provide new possibilities for musical applications, the existing immersive virtual instruments are limited to single process instruments or musical navigation tools. In this paper we present the 3D reactive widgets. These graphical elements enable simultaneous control and visualization of musical processes in 3D immersive environments. They also rely on ...
متن کاملThe Ixiquarks: Merging Code and GUI in One Creative Space
This paper reports on ixiQuarks; an environment of instruments and effects that is built on top of the audio programming language SuperCollider. The rationale of these instruments is to explore alternative ways of designing musical interaction in screen-based software, and investigate how semiotics in interface design affects the musical output. The ixiQuarks are part of external libraries avai...
متن کامل